Papers with loss-based attacks
MoPe: Model Perturbation based Privacy Attacks on Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work shows that Large Language Models can unintentionally leak sensitive information . a new method to identify with high confidence if a given text is in training data is proposed . |
| Approach: | They propose a method to detect if a given text is in a pre-trained language model . they show that MoPe is more effective than existing loss-based attacks . |
| Outcome: | The proposed method is more effective than loss-based attacks and perturbation-based methods. |